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FIELD OF THE INVENTION 
The present invention relates to devices for the processing of images and in particular 
for the compression of static images to a high degree and the obtaining of a restored image of 
high image quality. More specifically, the subject of the present invention is the method for 
15 construction of a filter bank for the compression of bi-dimensional static images. 

The present invention relates generally to image processing techniques, and more 
particularly to interpolating filter banks based on non-separable wavelet basis for use in 
processing static images. 

BACKGROUND OF THE INVENTION 
20 Still images are an effective means for describing various subjects. Information about 

the subject is accumulated in image databases. At the present time a great multitude of types 
of databases have been developed that are oriented to the applications of special methods of 
analysis and information processing. 

Current digital transmitting systems have a number of advantages for image 
25 processing in comparison with analog systems. Recently developed techniques have led to 
improved methods to reduce image size. Such methods are extremely useful for digital data 
storing and processing or manipulating. So it may be said that data size reduction is a 
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compression process. As to the architecture, it is possible now to put a complete compression 
process into a single chip. The main objective of a compression process is to achieve the 
highest compression ratio and in the same time to provide the minimum data loss that may 
lead to decompressed image quality degradation. 

SUMMARY OF THE INVENTION 

The present invention is better understood upon consideration of following definitions: 

arithmetic coder : An entropy coder used to represent the data compactly. 

coder : An embodiment of either an encoding or decoding process. 

color image : An image that has more than one component. Thus color image used for 
given invention has three components - Y, Cb, Cr. 

discrete wavelet transform (DWT) : A wavelet transformation resulting in, spatially 
discrete coefficients. 

encoding process : A process, which takes as its input a source image and outputs 
compressed image data. 

image : A set of two-dimensional arrays of data. 

lossless coding : Encoding process in which all of the procedures are lossless. 
lossy coding : Encoding process that is not lossless. 

quantization : is a process for data volume reducing. So the main purpose is to reduce 
number of bits for entropy encoding. 

Of late there has been significant interest in the compression of video as well as of 
static images. This was stimulated by the rapid development of information technology, 
computerization and digital communication technology. In such conditions the image is 
represented in digital form as a rather large quantity of bits 

Compression permits one to significantly decrease the amount of memory necessary for the 
storage of data and to reduce the time for their transmission (to acceptable rates). 

The compressions of images without loss and with losses are distinguished. The first 
is characterized by insignificant compression coefficients whereas the second ensures much 
higher degrees of compression. However the problem lies in the search for a compromise 
between the level of loss upon restoration of the image and the degree of compression of the 



original image. The higher the degree of compression, the higher the level of loss upon 
restoration of the image, which, obviously, distracts from the visual quality of the image after 
decompression. Thus, the image may be described as the graphic form of the presentation of 
data intended for visual reception. Apart from the visual evaluation of the obtained image, 
5 there also exist other criteria, for example, the widespread criterion of PSNR (peak-to-peak 
signal-to-noise ratio), that determines the relationship of the original image to the restored 
image after compression, and is calculated thus: 



of the pixel of the restored image, and M and N are the dimensions of the image. 

The values of PSNR were calculated for images restored after use of the given method 
and were compared with values of PSNR after use of the standard JPEG2000. Comparative 
data representing images restored after compression with the assistance of the given method 

15 and the JPEG2000 standard, and the digital values of PSNR are entered in FIGs. 3-8. In FIG. 
3 digital values of PSNR are presented for images in the QCIF format, in FIG. 4 the originals 
of the images and the images after compression with the JPEG2000 method and with the 
given method, thus, if the possibility to evaluate the visual quality of the image after 
application of the given method. In FIG. 5 the digital values of PSNR are entered for images 

20 of the SIF format, in FIG. 6-8 the test images themselves are presented, both the originals as 
well as those obtained after compression with the JPEG2000 method and the given method. 

The images restored after compression with the aid of the method that is the subject of 
this patent are sharper, in them the outlines of the subjects are viewed better. 

Moreover, several words must be said about the format of the images with which this 

25 method is used. At this time there are several formats for the presentation of images in data 
transmittal systems, for example RGB and YUV formats. The model known as a 
combination of the routing of the primary colors "Red, Green and Blue" RGB, is used in 
many monitors. On a black screen the addition of the three primary colors takes place. The 
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where x y is the value of the color or brightness component of the pixel of the initial image 
with coordinates i, j, and y tj is the value of the corresponding color or brightness component 



absence of all of these colors lends the black color, while their presence at maximum intensity 
gives the white color. 

YCbCr also is a prevalent format for the presentation of the images, where the color of 
the pixel is determined by the intensity of each of the components Y, Cb and Cr. Y represents 
5 the brightness, Cb and Cr are components of color diversity, whereby Cb is the difference 
between the intensity values of red and green and Cr is the difference between the intensity 
values of blue and green. In contemporary image compression methods the YCbCr format is 
used on the strength of the information content of the Y-component and to a much lesser 
degree on the strength of the information content of the remaining components. In the given 
10 invention the translation of the image from RGB into YUV format is presented in this way: 

Y = — (1R + 2B + 14G\ 
23 V } 

Cb = -^(R-3B + 2G\ 
69 V J 

Any image located in a computer is numbered and stored as a bitmap, that is, a matrix 
in which each element describes the color of a point on the image. To store the bitmap in 
such a form is undesirable due to the large quantity of computer memory required. The image 
15 consists of elements called pixels. For different formats of presentation of images, a pixel 
may contain a different number of bits. The presented method works with images in which a 
pixel contains 24 bits (bmp format). 

Moreover, there are different formats for the dimensions of frames during video 
transmittal. The most widespread of them are R601, SIF, and QCIF. The measurement of the 
20 frame in R601 format is 720x480 pixels, SIF is 352x240 pixels, and QCIF is 176x144. The 
encoder that is the subject of this patent operates with all image formats. 

Previously, for the compression of still images a discrete-cosine transformer (JPEG 
standard) was used. 

The discrete-cosine transformer was applied to the matrix of the image. The result of 
25 the transformation is such a matrix of coefficients for which coefficients with low values may 
be disregarded (that is, made null). To obtain the initial image, reverse transformation is used. 
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It is possible to present the work of the JPEG standard in several stages, described briefly 
below. 

First a conversion of the image is made from the RGB color field to the YUV color 

field. 

5 In the next step after the transformation the image is divided into square portions 

measuring 8x8 pixels. After this, a discrete-cosine transformation (DCT) is made on each 
portion. An analysis of each block, its decomposition into the component colors, and a 
subtotal of the frequency of the appearance of each color is thereby made. 

Thus, during transformation we obtain a matrix in which many coefficients are either 
10 close to or equal to zero. Moreover, owing to the imperfection of human vision, one can 
approximate the coefficients more roughly without a noticeable loss of image quality. 

For this, the quantization of coefficients is used. During this, a part of the information 
is lost, but larger compression coefficients may be obtained. 

However, with the passage of time the JPEG2000 standard, based on the coding of 
15 still images with the help of wavelet decomposition, appeared. The JPEG2000 standard also 
operates with color images, one of the important aspects here is the decorrelation of three- 
color components, in order that there may be the possibility of restoring the color component 
separately from the other components. Several words about the work of the JPEG2000 
algorithm: 

20 Several levels of wavelet-decomposition are applied to the image. These levels 

contain coefficients separated into sub-ranges, each level of decomposition consists of four 
sub-ranges: one approximating (containing low frequencies) and three detailed 
(corresponding to high frequency). 

The level of decomposition is connected to the subsequent degree of two. That is, the 

25 subsequent level of displacement contains half as many coefficients as the preceding, one may 
say that resolution will be twice as low horizontally as well as vertically. To limit the 
quantity of stored coefficients, quantization is applied. After quantization supplemental data 
processing takes place. If the data are stored without quantization, then it is obvious that the 
image will be restored without a loss of information in relation to the original. 

30 In general, the basic stages of operation of the JPEG2000 algorithm may be presented thus: 
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The color components of the image are separated, after which the image and its 
components are subjected to wavelet-transformation. After wavelet-transformation, the 
frequency coefficients, ordered by sub-ranges, are quantized and gathered in rectangular 
blocks for encoding. The bit-mapped surfaces of the coefficients in the encoded blocks are 
5 encoded with the help of an entropy encoder. The regions of the coefficients that are of 
interest may be encoded first. Thus, with the help of wavelet-transformation it is possible to 
obtain a much higher degree of compression. 

One of the most essential aspects of use of wavelet-decomposition is the correct 
choice of wavelet. For the task of image compression discrete wavelets work best of all. 

10 Bases on the grounds of uninterrupted wavelets are not orthonormal. Discrete wavelets, on 
the strength of their orthonormality, usually lead to more precise transformation and the 
presentation of a signal, and in particular to its reverse transformation after the compression 
procedure. Because of this they also are better suited for information transfer systems. The 
discrete wavelet basis succeeds with the assistance of an iterated algorithm with a change of 

1 5 scale and with the displacement of a single function. 

In accord with the basic aspect of the present invention, in the given invention for the 
compression of still images a discrete orthogonal transformation is used. 

The wavelet-transformation divides the signal into separate frequency components, 
which permits the study of each of the components and the receipt, in this way, of good 

20 frequency-temporal localization. That is, using the wavelet-spectrum of a signal there is the 
possibility of obtaining not only certain information about the frequency components of the 
signal (in the present case - of the image), but also to indicate their location on the temporal 
axis. This consists of the advantage of the wavelet-transformation in comparison with, for 
example, the Fourier transformation, which does not give information about the place where 

25 the signal frequency changed. 

After the execution of the wavelet transformation it is necessary to compress the 
obtained data, discarding any non-essential part of the encoded information. This is done 
with the help of the quantization procedure, which will be examined in detail below. Such a 
procedure leads to substantial reduction in the necessary computer memory and the demands 

30 during the transfer of information, which is the basic goal of image compression. 
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The process of restoration of an images proceeds in the reverse order. A detailed 
description and the attached drawings will help to more fully understand the essence of the 
present invention. 



5 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows a basic image encoding scheme. 

FIG. 2 depicts a frequency allocation after the first level of wavelet transform. 
FIG. 3 illustrates PSNR values for pictures restored after compressing by JPEG2000 
and given method. 

10 FIG. 4 illustrates visual quality of images compressed by JPEG2000 and given method 

(QCIF format). 

FIG. 5 illustrates PSNR values for pictures restored after compressing by JPEG2000 
and given method (SIF format). 

FIG. 6 illustrates visual quality of images compressed by JPEG2000 and given method 
15 (QCIF format). 

FIGs. 9-1, 9-2 depict filtering coefficients for the first wavelet decomposition level. 
FIGs. 10-1,10-2 depict filtering coefficients for the second wavelet decomposition 

level. 

FIGs. 11-1,11-2 depict filtering coefficients for the third wavelet decomposition level. 

20 

DETAILED DESCRIPTION 
Direct and reverse wavelet-transformation is calculated by means of calculation of 
signal packets with the function designated by the aggregate of values of coefficients at points 
of quantization. Taking into consideration the statistical peculiarities of the majority of 
25 signals (useful information distributed in the low-frequency range of the signal's spectrum, 
and interference/noise in the high-frequency range), the signal is transformed with the use of 
two complementary filters - both low frequency and high-frequency. 

The examined wavelets relate to the class that implements quadrature mirror filters. 
Their peculiarity is the fact that the high-frequency filter is obtained from the corresponding 
30 low-frequency filter by its simple transposition in the reverse order and a change of the sign 
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(even or odd). Thus the wavelet isolates local peculiarities of the signal (image) in each point, 
and thus is a high-frequency filter, while the corresponding low-frequency filter is described 
by a scaling function. Since said method is based in a two-dimensional discrete wavelet 
transformation, then the high- and low-frequency filters corresponding to it are matrices. The 
matrix notation is, in the given case, the most appropriate method, allowing one to effectively 
execute the wavelet-decomposition. 

Algorithms on the basis of the wavelet-transformation as well as on the basis of DCT 
consist of three steps: 

1 . a de-correlated transformation; 

2. a quantization procedure; 

3. entropic encoding. 

The general plan for image encoding is presented in Fig. 1 . 

The choice of wavelet basis for the encoding of data suitable for wavelet- 
transformation is one of the most difficult tasks. Therefore, in each case experiments are 
made to satisfy the following criteria for wavelet evaluation: 

1. evenness; 

2. accuracy of approximation; 

3. size of the region of measurement; 

4. frequency selectivity of the filter. 

When observing the given criteria it is necessary to take into consideration the 
requirements presented against the final result. Depending on the task given, the properties of 
the wavelets may be considered in different ways. For example, if the restored image should 
not be substantially distinguished from the original, then in that case the compression will be 
poor. A strong compression is necessary, for example, during transmission of information on 
channels with limited bandwidth. In the present invention wavelets are gathered which meet 
the criteria suitable for the strong compression of images. 

The separable basis is the simplest type of wavelet basis for images. The use of the 
separable basis is traditional for contemporary codes. Nonetheless, non-separable bases may 
be more effective. 
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A basic aspect of the present invention is the use of a non-separable wavelet basis for 
the coding of still images. On the whole contemporary methods for the compression of still 
images with losses are based on filters constructed with the help of wavelet bases. As a rule, 
they are based on the use of one-dimensional wavelets - the use of the scheme of S. Mallat, or 
5 a tensor product of one-dimensional methods. The basis of these methods is the cascade 
algorithm DWT, which is based on a decomposition formula (direct method) 

c{ = 2>r h n . 2k , d> = x^ +, f»- 2 * , (*„=(- 1) 1 "" ) 

neZ neZ 

and a reconstruction formula (reverse method) 

neZ neZ 

10 The quality of algorithms based on wavelet bases depends substantially on the choice of 
coefficients h n of the filtering mask. 

In accord with the fundamental aspect of the present invention a new digital filter is 
proposed, based on non-separable wavelet bases. 

In accord with another aspect of the present invention the corresponding algorithm 
15 DWT is presented, which permits one to construct methods for the compression of images of 
different dimensions, with a degree of compression exceeding the existing methods. 

Filters H 0 ,H ]9 H 2 are constructed for the three steps of the decomposition. The 

coefficients H k = {h k j }"__ 21 (k=0,l,2) for the filters are symmetrical. This property may be 
presented thus: 

20 h k = h k h k -h k h k -h k 

^ u n U n i,\-j > n ij n \-ij ' n ij n i-i f \-j • 

In FIGs. 9-1 and 9-2 the coefficients hfj(ij = 0,1,...,20) are entered in tables, in FIGs. 

10-1, 10-2 the coefficients h)j(ij = 0,1,..., 20) are entered in a table and the coefficients 

hfj (ij = 0,1,.. .,20) are entered in tables in FIGs. 11-1 and 11-2. On the strength of the 

symmetry, if h k } are known for ij=0J f 20, k=0,l f 2, then the remaining coefficients are 

25 determined unambiguously. 
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The filter H 0 is used in the transition from the null (pixel level) to the first level of 
separation of frequency, the filter H l is used for the transition from the first to the second 
level and the filter H 2 for the transition from the second to the third level. 

For the separation of frequency for each level on the basis of the obtained masks of 
5 filters an array of filters is constructed according to the following rules 

G*' 1 = l?*,m }> where g k n '* m = (- l) m h k _ lm , 
G k ' 2 = fe.'i }, where g% =(-l)"< m , 
G w = where g" =(-l) n+m K^. 
We shall describe the use of the indicated filters. 
10 Through c?j the initial value of the color component for the pixel is designated with the 

number (ij). 

Using the mask of coefficients hf j image filtration is conducted on the lower c°* m , the 
middle c l * m , c^ m and the higher c^ m frequencies in accord with the decomposition formulas: 

.0,1 y 0.0.0 *,i = y o,o o f * (k=l 2 3) 

ij U 

15 As a result, the filtered upper and lower frequencies of the image displaced into the 

corresponding four sub-ranges are obtained. The distribution of the obtained frequencies after 
the first level of transformation is indicated in FIG. 2. 

For the panel of values c° n ,l m the same decomposition formulas are applied, but the 

filter the filter Hj is used in place of the filter//^, filter G 1,1 is used in place of filter G 0 ' 1 , 
20 filter G 1 ' 2 is used in place of filter G 0 ' 2 , and filter G 1 ' 3 is used in place of filter G 0 ' 3 : 

C n\m ~ S C i,}^i-2«,y-2m5 C n,m = ^ C iJ %i-2n J-2m > (k=l,2,3). 

ij U 

Similarly, decomposition formulas are used for the panels of middle and high 
frequencies. 

After this procedure, the decomposition formulas are used again, but with the masks 
25 H 2 , G 2,1 , G 2 ' 2 , G 2 ' 3 . As a result, 64 panels of coefficients are obtained. 
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The fragment of pseudocode for the corresponding decomposition calculation are shown 
below: 



for(y=0;y<Y;y++) 






for(x=0;x<X;x++) 




{ 








s0=sl=s2=s3=0; 




for(j=0;j<J;j+ 


+) 




for(i=0;i<I;i++) 




{ 


s0+=c(ij)*h(i-2*xj-2*y); 
sl+=(-iy*c(i,j)*h(i-l-2*x,j-2*y); 
s2+=(-l) i *c(ij)*h(i-2*xj-2*y); 
s3+=(-l) i+j *c(ij)*h(i-l-2*xj-2*y); 




} 






w[0]=sO; 






w[l]=sl; 






w[2]=s2; 






w[3]=s3; 




} 







20 

Further all coefficients are put into descending order and after the choice of the given 
quantity of coefficients, (which is determined by the degree of compression), all remaining 
data are quantized according to a linear scale. Pre-quantized coefficients are designated with 
y where £)[•] is the quantization operator. Under quantization in the present 

25 invention a non-linear operation is understood, which leads to a reduction in the volume of the 
transferred data and, correspondingly, to a loss of information. In the present method a scalar 
quantization is used, in which each element from the set of coefficients y is quantized 

individually. The scalar quantization converts the intervals from real numbers [q* ) to 

real numbers. Thus, 
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is obtained for all y[k] 9 satisfying the condition q\ < y[k] < q- +] , where i is the level of 

quantization, k is the quantization step. 

Further the quantized values are coded by the RLE method and the arithmetic coding 
method. 

After the application of scalar quantization, the group compression method and the 
arithmetic coding method we obtain a data file. 

For the restoration of the encoded image reconstruction formulas are used. For the 
given values cjjj,, c^,c^,c^ calculate c° n a m according to the rule: 

C n,m ~ J*j C Li h n -2i.m-2i + X!X! C /W 8n-2Lm-2i (k = l,2,3), 

similarly we find c°* m 

C n\m ~ y^jCj'i h n -2i,m-2j ^ C L ) §n-2i,m-2j (k = l>2,3), 

f,7 P=l i,7 

and c„°'° 

~^j C i,jhn-2i,m-2j + ^ XI C '0 8n-2i,m-2j 0^=1,2,3). 

1,7 '.y 
Similarly, we find the values c x „ m , c*'* , et al. 



12 



The fragment of pseudocode for the corresponding reconstruction calculation are shown 
below: 



for(y=0;y<Y;y++) 




for(x=0;x<X;x++) 




{ 




s=0; 




for(j=0;j<J;j+ 


+) 


for(i=0;i<I;i++) 


{ 






s+=w[0]*h(x-2i,y-2i); 




s+=w[l]*(-iy *h(x-l-2i,y-2j); 




s+=w[2]*(-l) i *h(x-2*i,y-2*j); 




s+=w[3] *(- 1 *h(x-l -2*i,y-2*j); 


> 




} 
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To reduce the influence of the border the image continues evenly from the left and 
upper edges and connects at the opposite edge. Further, the image is transformed from RGB 
to YCbCr according to the formulas 

Y = ^(1R + 2B + UG\ 

Cb = -—(R-3B + 2G\ 
23 ' 

Cr = — (SR-B-7G). 
69 V ' 

After the restoration of the components YCbCr at the null level (the pixel level) the color 
range is transformed into the RGB palette. 

R = Y + -Cr; 
2 

G = Y-^{Cb + 3Cr}, 

B = Y + -Cb. 
4 
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INDUSTRIAL APPLICABILITY 

The current invention discloses methods and procedures for still image compressing 
using filter bank based on non-separable wavelet basis. The methods and procedures 
disclosed in the current application can be executed or preformed in a computer, other 
microprocessors, programmable electronic devices or other electronic circuitry that are used 
for encoding images. They can be loaded into the above devices as software, hardware, or 
firmware. They can be implemented and programmed as discrete operations or as a part of a 
larger image compression strategy. 

Thus, the present invention describes a method for the compression of still images 
with the assistance of non-separable wavelet bases. In compliance with the statute, the 
invention has been described in language more or less specific as to structural features. It is 
to be understood, however, that the invention is not limited to the specific features shown or 
described, since the means and construction shown or described comprise preferred forms of 
putting the invention into effect. Additionally, while this invention is described in terms of 
being used to provide a method for compression of still images, it will be readily apparent to 
those skilled in the art that the invention can be adapted to other uses as well. The invention 
should not be construed as being limited to still image compression and is therefore, claimed 
in any of its forms or modifications within the legitimate and valid scope of the appended 
claims, appropriately interpreted in accordance with the doctrine of equivalents. 
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